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(54) Electronic image sensor 

(57) An image sensor device capable of snap shot 
colour applications comprising an array of image regis- 
ters (452) for converting the light from successive image 
frame exposures into indicative charge packets, and an 
array of light-shielded storage registers (454) inter- 
spersed in regular displacements among the array of im- 
age registers for receiving the transfer of the charge 



packets from adjacent image registers over multiple im- 
age frame exposures, 

whereby for example, red ; green, and blue colour image 
frames can be acquired upon the opening of a flash ex- 
posure shutter and transferred in parallel into the stor- 
age registers from which the three frames can be read 
out as a colour image when the shutter is closed. 



450 



IMAGE 
REGISTER 



454 



STORAGE 



TRANSVERSAL 
FILTER 



456 



470 



n 

EXPOSURES 



■ MEMORY 
CONTAINING 
EXPOSURES 
AT t!... t n 



476 
LIGHT 
SHIELD 



458 



472 



RED AT t { 



GREEN AT t t + 200 Msec 



BLUE AT t] + 400 usee 



-474 



CM 
< 
O 

00 

N 

O 

CL 
LU 




vout FIG. 1 



478 Vout 



459 



479 



Printed by Jouve. 75001 PARIS (FR) 



BNSDOCID: <EP 0774870A2> 



4) 1 EP 0 774 

Description 

The present invention relates to electronic image 
sensors and. more particularly, to such sensors, e.g., of 
the colour snap shot type, that are capable of high speed $ 
imaging. 

Currently in the electronic image sensing art most 
electronic image sensors are either of an interlaced or 
non-interlaced type. This means, among other things, 
that all of the detector population is either 1 ) reset every 10 
1/60 to 1/30 of a second, or 2) reset, one field at a time, 
every 1/60 sec with two overlapping integration times. 
The readout usually occurs during the image acquisition 
and utilizes all the frame time. Most snap shot type elec- 
tronic image sensors are of the non-interlaced type, that * 5 
is. all of the detector population is reset after every ex- 
posure and then read out in the dark without light inci- 
dent on the sensor. To generate a colour image of a 
scene, typically three sensors are utilized to simultane- 
ously image the scene in different colours and then the 20 
three image signals detected are read out in parallel, as 
is the case in broadcast applications. Alternatively, a 
mosaic colour filter can be utilized on the detectors and 
then chrominance and luminance signals, composed 
from the electronic output of the image sensor array, can 25 
be used to reproduce the image. One other known tech- 
nique in this regard uses a colour filter wheel and reads 
out one image frame at a time during three consecutive 
exposures. This last method requires a very long image 
freeze time. i.e.. several seconds, to be able to read out 30 
the first colour image, e.g., red, before imaging the next 
frame, e.g., green, and again to read out the green im- 
age before imaging the blue frame, so that it is not very 
practical for any motion scenes and thus for video ap- 
plications. 35 

In high speed imaging of objects in motion, such as 
imaging objects from moving platforms like aircraft, or 
imaging a scene with multiple colour bands, it is neces- 
sary to rapidly integrate several exposures, e.g., every 
1/100 to 1/60 sec. and then store the image frames cor- -to 
responding to these exposures on a chip in preparation 
for readout or further image processing. Further 
processing on the chip may involve, for example, time 
delay and integration, colour processing, frame averag- 
ing, spatial filtering, etc. Thus, the available area on the 45 
chip for these various functions becomes a concern. 

A sensor device is shown in U.S.Pat.Nos. 
4,821,103 exemplify a prior art approach involving the 
detection and rapid storage of separate exposures of an 
image frame, two in this case, and then subsequently 50 
reading out the stored exposures to compose the image. 
In particular, TAKEMURA uses two storage registers at 
one end for handling the two separate exposures in a 
video application. 

U.S.Pat.No. 4.924.316 pertains to video colour im- 55 
aging wherein the colour images are applied to individ- 
ually colour filtered light sensitive detector units and the 
red (R), green (G), and blue (B) fields are stored sepa- 
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rately. 

While these prior art approaches have various ad- 
vantages, they all are directed to video systems, do not 
take snap shot type detector devices into account, and 
all have the disadvantage of requiring extra chip real es- 
tate for storage. 

The present invention seeks to provide an image 
sensor device with memory or frame store large enough 
to store multiple exposures. 

Such an image sensor device may be provided with 
memory or frame store large enough to store several 
image frames, acquired from exposures that are gener- 
ated in a rapid sequence, and to read them out later in 
sequence after all the exposures are completed. 

The sensor device may be capable of snap shot col- 
our applications wherein, for example, red. green, and 
blue colour image frames can be rapidly acquired upon 
the opening of a flash exposure shutter and very rapidly 
transferred in parallel into storage registers from which 
the three frames can be read out when the shutter is 
closed. 

The present invention is directed to image sensor 
devices, particularly such devices of the snap shot type, 
either flash or non-flash, and involves the provision of 
memory or frame store on the imaging surface, large 
enough to store charge packets from multiple image 
frame exposures, along with various constructions for 
implementing such sensor devices and clocking 
schemes to drive them. The invention makes it possible 
to store several image frames, that are generated in a 
rapid sequence, e.g.. during a flash exposure, and to 
read them out later in sequence after all the frame ex- 
posures are completed. Hence, when an image sensor 
device in accordance with the invention is used in snap 
shot colour applications, red. green, and blue colour im- 
age frames can be rapidly acquired upon the opening 
of a shutter, and very rapidly transferred in parallel into 
storage registers from which the three colour frames can 
be read out as a colour image when the shutter is closed. 
A filter wheel with opaque portions can be used with a 
frame transfer (FT) embodiment to block the field of view 
between the sequential colour exposures and hence fa- 
cilitate the parallel readout without colour smear. Alter- 
natively, an interline transfer (IT) image register embod- 
iment may be used with light shields covering vertical 
CCD registers to allow rapid parallel transfer of the ac- 
quired images to these storage registers without smear- 
ing, obviating the need for the opaque portions on the 
wheel. In this embodiment each vertical register either 
has (R, G. B) memory sites interleaved with the detec- 
tors in the image register or has a large frame store be- 
low the image register. 

For a snap shot sensor to be very high in resolution, 
typically it would be necessary to construct a large an- 
alog storage register below the image register, and 
since the storage register will normally occupy a large 
physical space, e.g., 50% of that of the image register, 
the chip size of the sensor would tend to be too large. 
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The invention, in providing a large format sensor imple- 
ments the analog charge storage inside the image reg- 
ister in the form of a colour separation sensor. The im- 
age register has light-shielded or opaque sites every few 
lines to store, for example, the first two colour exposures 
of a three colour snap shot camera. Such an arrange- 
ment is adequate for high resolution since one can sam- 
ple chroma with lower spatial resolution to produce an 
acceptable colour image. The opaque sites can be pro- 
vided in either frame transfer (FT) or interline transfer 
(IT) sensor architectures. 

In order that the invention and its various other pre- 
ferred features may be understood more easily, some 
embodiments thereof will now be described, by way of 
example only, with reference to the drawings, in which: - 

Figure 1 is a block diagram of one embodiment of 
sensor device constructed in accordance with the inven- 
tion. 

Figure 2 is a block diagram of an alternative embod- 
iment of sensor device constructed in accordance with 
the invention utilizing a frame transfer (FT) arrangement 
and a colour filter wheel. 

Figure 3 is a block diagram of another embodiment 
of sensor device constructed in accordance with the in- 
vention utilizing a vertical interline transfer (IT) arrange- 
ment along with a colour filter wheel. 

Figure 4 is a block diagram of a further embodiment 
of sensor device constructed in accordance with the in- 
vention using a vertical field IT (FIT) arrangement and 
a colour liquid crystal shutter or filter wheel. 

Figures 5a - 5c are schematic diagrams of embod- 
iments of the invention in which analog charge storage 
is implemented in different arrangements within the im- 
age register of an FT CCD architecture, similar arrange- 
ments being possible in the vertical register of an IT 
CCD architecture . 

Figure 6 shows details of the operative structure of 
the embodiment of the device of Figure 5a along with a 
colour filter wheel to facilitate the integration of the dif- 
ferent colour images. 

Figure 7a is an exemplary illustration of the dispo- 
sition of charge packets in a super pixel after a red-blue- 
green (RB,G) exposure sequence. 

Figure 7b is an exemplary illustration of the charge 
packets in the super pixel shown in Figure 7a during re- 
adout. 

Figure 8a is an exemplary illustration of the dispo- 
sition of the charge packets in a super pixel after a red- 
blue-green (R,B,G) exposure sequence done under 
high positive bias (buried channel) mode to achieve high 
charge storage density. 

Figure 8b is an exemplary illustration of the charge 
packets in the super pixel shown in Figure 8a during re- 
adout. 

Figure 9a illustrates a clocking scheme for accumu- 
lating colour image frame charge packets with a switch- 
ing time resulting from the operation of a filter wheel or 
liquid crystal shuttered filter during a flash exposure in 



a high speed three colour snap shot camera incorporat- 
ing the invention. 

Figure 9b shows a super pixel charge sequence in 
keeping with the charging timing of Figure 9a. 
s Figure 1 0 is a block diagram (frustrating one embod- 
iment of a camera incorporating a snap shot imager con- 
structed in accordance with the invention. 

Referring to the drawings, a large format sensor is 
implemented by arranging the analog charge storage in- 
fo side the image register in the form of a colour separation 
sensor. The image register is provided with light-shield- 
ed or opaque sites every few lines to store charge pack- 
ets produced by image frame exposures, e.g., the first 
two colour exposures of a three colour snap shot cam- 
's era. This arrangement is adequate for high resolution 
colour imaging since chroma can be sampled with lower 
spatial resolution and produce an acceptable colour im- 
age, and the chip area need not be much larger than the 
imaging area, minimizing the required real estate for 
20 storage. Also, the last colour to be exposed may be se- 
lected for sampling to a higher resolution than the pre- 
vious two. 

The first embodiment illustrated in Figure 1 has a 
sensor device 450 which includes a photosensitive im- 

25 aging region or image register 452 that receives light 
from a coloured image, integrates the charge packets 
produced by a succession of n colour exposures, and 
delivers them, one exposure at a time, to light-shielded 
memory sites or storage registers 454 which, physically 

30 are dispersed between the light receiving lines of the 
image register 452. The succession of colour exposures 
can be obtained using the same or different colour fil- 
ters. A transversal filter 456. or alternatively a recursive 
filter, is then used to process the analog image signals 

35 in parallel, generating a pattern recognition flag or other 
control actions, and the processed signals are read out 
by a readout section or register 458 to a charge-sense 
amplifier 459. The filter 456 may be used in doing time 
delay and integration (TDI) of the images or simply 

40 frame averaging . 

Alternatively, the transversal filter 456 may be dis- 
pensed with and the images can simply be read out in 
series. Various embodiments not using such a filter are 
shown in Figures 2, 3, and 4, and, in cooperation with a 

^5 colour filter wheel 460 : operate to integrate the different 
colour images. The filters 462 in the wheel 460 can be 
visible, or I R filters for image fusion applications and oth- 
er non-colour image acquisition. 

In the embodiment shown in Figure 2, a frame trans- 

50 fer (FT) organization, arrangement, or architecture is uti- 
lized and the filters 462 on wheel 460 are separated by 
opaque regions to prevent smearing during image frame 
transfer. More particularly, the alternative exemplary 
sensor device 470 in Figure 2 has a configuration that 

55 allows real time resolution adjustments of the chroma 
signals in a manner as will now be described. Sensor 
device 470 may have an image register 472 in the form 
of a 500 x 500 array of photosensitive charge-packet- 
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forming regions with every four lines in the image reg- 
ister 472 being followed by a light-shielded mini-storage 
register 476 (in a manner as shown in detail in Figure 
6). The opaque storage regions making up the storage 
registers may be formed by permanently depositing 
metal layers on the sensor surface, or by locating a glass 
filter, having predesigned opaque areas, in front of the 
sensor before an image exposure. They may also be 
formed by depositing an opaque layer or an electrically 
controlled liquid crystal (X-tal) shutter layer over these 
lines of the image register. 

In operation, by way of example, the device 470 
may first be exposed to the blue portion of an image, 
followed by the green and then the red portions (B.G, 
R). These three image frames of different colours may 
be formed during a flash exposure created by the open- 
ing and closing of a camera shutter and using a rapidly 
operating colour filter device. Thus, the three colour ex- 
posures may be done rapidly e.g., at about 200 jasec 
intervals. It will be understood, however, that the entire 
resolution of the image register 472 may not be required 
for each colour, and that different resolutions for the dif- 
ferent colour exposures may be desirable, so that adja- 
cent rows of charge in each exposure frame are com- 
bined at interface 474. between the image register 472 
and the storage register 476. as each exposure frame 
is being transferred into storage register 476. The way 
in which rows of charge are combined at interface 474 
for each of the colour exposures will vary depending up- 
on the desired resolution for the particular colour. For 
example, only one-fifth of the image register's resolution 
may be desired for the blue exposure, so that every five 
lines of the blue exposure frame will be combined into 
one at the interface 474 for storage in storage register 
476. 

If a higher or full resolution is desired for the green 
exposure, then every two lines may be combined at the 
interface 474 as the green exposure frame is being 
downloaded into storage register 476. Finally, the de- 
sired resolution for the red exposure might be some- 
where in between, with every four lines of charge being 
combined before storage. Again, the processed signals 
are read out by a readout section or register 478 to a 
charge-sense amplifier 479. 

In the embodiments shown in Figures 3 and 4, a 
vertical interline transfer (IT) organization or arrange- 
ment is used to store the three colours. In the device 
480, as shown in Figure 3, the columns 482 of photo- 
sensitive charge-forming elements 484 are alternated 
in the image register 486 with vertical CCD registers 488 
which quickly transfer the charge from the associated 
columns 482 of charge-forming elements 484 into the 
storage register 490. The charge packets from succes- 
sive colour exposures may be stored in storage register 
490 sequentially as shown in Figure 3. The processed 
signals are read out by a readout section or register 478 
to a charge-sense amplifier 489. 

Alternatively, the charge packets from each individ- 



ual column over the three colour exposures may be 
stored in parallel adjacent sites such as shown in the 
device 480' in Figure 4, that is. the first column of storage 
register 492 accepts charge packets from the first col- 
5 umn of image register 486' and only from the red expo- 
sure (designated 1R. 2R. 3R . . . ): the second column 
of storage register 492 contains charge packets from the 
first column of image register 486' and only from the 
green exposure (designated 1G. 2G, 3G . . . ); and so 
io on. This memory storage arrangement of the image 
charge packets in the storage register 492 in parallel ad- 
jacent sites allows for ease of analog signal processing 
with on-chip filters, e.g., to do multicolour spatial filter- 
ing. An advantage of this FIT organization is that the 
'5 vertical CCD register may be covered by a light shield 
to prevent image smear in cases where no opaque re- 
gions are used between filters on the colour wheel. In 
all cases the vertical transfer of images to the store is 
done at high speed, i.e., < 200 - 250 jisec. In the em- 
20 bodiments of both Figure 3 and 4. the storage register 
below the image register may not be required if the ver- 
tical registers of the interline sensor are designed with 
two colour, e.g.. R and G. storage while the third colour 
B. is stored in the sense node awaiting its turn in read- 
25 out. The image register 486' may be reset to a dump 
drain before integrating the second image, but this is not 
essential. The images can be formed by all of the de- 
tectors in the array or by sub-sampling of these detec- 
tors since, as noted, it is generally not required to have 
so full resolution on chroma signals. The latter technique 
allows size reduction of the storage register. 

Figures 5a - 5c are exemplary schematic diagrams 
of alternative ways in which analog charge storage can 
be implemented within the image register using various 
35 storage schemes or arrangements. In these three em- 
bodiments, the respective image registers. 500, 506. 
and 512. receive light from a coloured image and inte- 
grate the charge packets produced by the succession 
of n colour exposures and deliver them one at a time to 
-to light-shielded or opaque memory sites or storage regis- 
ters, 502, 508. and 509. respectively Figure 5a shows 
an embodiment in which the charge storage is imple- 
mented in image register 500 in continuous transverse- 
ly-arranged storage blocks 502 of storage lines 503 al- 
-*5 ternating vertically with blocks 504 of imaging lines. 
Blocks define a group of lines and lines are defined by 
their gate electrodes. In IT architectures these lines will 
alternate horizontally with the imaging detectors. Figure 
5b shows an embodiment in which the charge storage 
so is implemented in image register 506 in blocks 508 of 
discontinuous storage lines 507 alternating with imaging 
blocks 510. Figure 5c shows an embodiment in which a 
staggered storage scheme is employed in image regis- 
ter 51 2. with storage blocks 509 alternating with imaging 
55 blocks 511 in the register lines. The number of opaque 
storage sites may be equal to or less than the number 
of imaging sites. Thus, charge binning, i.e., combining 
several image samples in one storage site, may be per- 
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formed in the image or storage area before storage. The 
storage blocks may be contiguous or randomly scat- 
tered across the image field to avoid artifacts in the dis- 
played image. 

The designs shown in Figures 5a to 5c may be used 
to produce a "3" or an "n" colour image. Alternatively, 
they can be used to produce, for example, three blue 
images, each taken at a different spatial frequency 
(charge binning conditions) to better estimate local col- 
ours in a region, i.e., to more accurately measure blue 
in the case of low quantum efficiency such as with a front 
illuminated CCD. 

Figure 6 illustrates in some detail an exemplary con- 
struction of the embodiment of the device of Figure 5a 
along with a three colour filter wheel 51 4 to facilitate the 
integration of the different colour images. As with the 
other embodiments using filter wheels : the filters 515 
may be a variety of different types, e.g. : visible light fil- 
ters for colour imaging, or infrared filters for image fusion 
applications. In the Figure 6 embodiment, image regis- 
ter 500 is shown as constructed of imaging blocks 504, 
each arranged transversely in four lines 516. comprising 
a plurality of photosensitive charge-packet-forming ele- 
ments, and separated by two storage register lines 518 
and 520 that are separated by an imbedded barrier 522. 
Each storage register line comprises a plurality of 
opaque storage elements and the two lines 518, 520 ; 
together with the barrier 522 form a block 502 in Figure 
5a. The combination of image subpixels in lines 516 of 
a block 504 and the memory locations in lines 51 8 - 522 
may be treated as a super pixel, that is. a region capable 
of charge manipulation of the image and cross talk 
charges by charge binning or separation or charge 
dump using appropriate timing and control pulses, e.g., 
from a 3-phase ($ V1 - <b y $) readout clock, applied to the 
drive electrodes 524. These super pixels, containing 
several subpixels and memories for storing colour sam- 
ples and cross talk charge samples, may be co-located 
with transversal filters that are capable of spatial filtering 
and time delay and integation and which use separate 
parallel CCD registers for delay and accumulation. 

In one operating embodiment, a red-blue-green col- 
our exposure sequence (R,B.G) may be employed to 
capture an image. After the red exposure, the charge of 
the four red pixels, i.e.. in the charge-packet-forming el- 
ements of each group of four lines or rows 516, is added 
and stored in the opaque storage line 518 which may 
have an inverted or non-inverted gate, i.e. a buried 
channel or multi pinned phase (MPP) mode. The same 
operation is repeated after the blue exposure with the 
charge accumulated in lines 516 being stored in the cor- 
responding opaque storage elements in storage line 
520, but without moving the red charge stored in storage 
line 518, or just by advancing it one stage to another 
opaque stage. The green exposure follows with the 
charge generated therefrom occupying lines 516. Fig- 
ure 7a is an exemplary illustration of the disposition of 
the charge packets in a super pixel after the foregoing 



exposures, wherein the red and blue charge packets are 
stored in memory lines 518. 520 and the green charge 
packets occupy the four lines 516. The charge so col- 
lected and stored in the device 500 may then be read 
5 out in appropriate sequence. The two storage capaci- 
tors and the separation gates normally used with stor- 
age lines 518 and 520 can be clocked separately (during 
charge binning and storage as described above) or in 
parallel synchronized with 3 phase (<J> V1 - <t> v3 ), or 4 

w phase, readout clocks controlling the imaging elements 
in lines 516 of the image register. The clocking may be 
done in non-inverted, inverted, or mixed modes. During 
readout the four image pixel groups and the storage 
gates will be used to readout 3 colour (filtered) image 

is data. This technique permits the inclusion of blank pixels 
separating some of the colours and therefore improves 
the dynamic range on some of the colour components. 
In the foregoing example the last, i.e., the green, expo- 
sure will almost have the full resolution of the image sen- 

20 sor. Regarding the blank pixels, Figure 7b is an exem- 
plary illustration of the charge packets in the super pixel 
shown in Figure 7a during readout. Two blank subpixels 
E1 and E2 are provided, with E1 containing a colour 
cross-talk signal occurring by CTE and E2 receiving red 

25 signal spillover if the red charge stored in the adjacent 
memory is much greater in dynamic range than the 
charge capacity of the wells during readout. 

In the embodiment shown in Fig. 2, wherein a frame 
transfer (FT) organization is used, the colour filters on 

30 the wheel are separated by opaque regions to avoid or 
correct for no smear during image transfer. In the em- 
bodiments of Figs. 3 and 4.. however, wherein a vertical 
interline transfer (IT) organization is used to store the 
three colours, an advantage of this organization, as 

35 mentioned previously, is that the vertical CCD register 
is covered by a light shield which prevents image smear 
in cases where no opaque regions are used between 
filters on the colour wheel, and thus no opaque regions 
need be used between filters. 

•to in all cases the vertical transfer of images to the 
store is done at high speed, i.e., < 250 jasec, with mul- 
tiple exposures being integrated and stored without 
downloading the device between exposures. The image 
register may be reset to a dump drain, e.g., above or 

■*5 below the image register or in a vertical overflow struc- 
ture to substrate, before integrating the second image, 
but this is not essential. The images can be formed by 
all the detectors or by sub-sampling of these detectors 
since, as noted, it is generally not required to have full 

so resolution on chroma signals. The sub-sampling tech- 
nique allows size reduction of the storage register. 

Enhancements to the image acquisition technique 
of Figure 6 may be employed to reduce colour cross- 
talk and enhance the dynamic range of the storage for 

55 one of the colours. For example, as shown in Figure 8a, 
following the red and blue exposure, the charge accu- 
mulated in a group of lines 516, due to the green expo- 
sure, may be combined into one line such as, e.g., the 
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third line. Also, colour cross talk charge CT is formed in 
the memory during exposure and storage, e.g., during 
the switching of colours in a liquid crystal shuttered filter 
while the flash is on. The charge storage in memory 
(518, 520) during exposure may be done under high 
positive bias (buried channel) mode to achieve high 
charge storage density and hence minimize the opaque 
area or memory region required. Thus, high fill factor is 
achieved. Readout is done in MPP mode in order to re- 
duce dark current charge in the image. When the charge 
in device 500 is read out under these circumstances, 
there is. in effect, a "buffer" row between the rows con- 
taining the green information and those containing the 
red and blue information, as shown in Figure 8b. This 
"buffer" row (CT. ET) provides two important advantag- 
es. First, due to row CT. cross-talk between the blue and 
green information is reduced because the rows corre- 
sponding to these two different types of information are 
no longer adjacent. Second, the dynamic range of the 
device for green information is increased due to the ad- 
ditional storage area provided by the empty row ER ad- 
jacent to and behind the green storage line. Thus, any 
charge from the green exposure which "spills" over into 
the "buffer" row during readout will not be lost or mixed 
with charge from the blue exposure. This is particularly 
important when the filter wheel is rotating and the first 
colour is being stored in the opaque region within a sin- 
gle flash time. Hence, clearly the transient period may 
present some inaccuracy, which is particularly true 
when liquid crystal shuttered filters are used, since there 
may be some colour and spatial cross talk when switch- 
ing from the first colour to the second. This cross talk 
charge generated in the cross talk period may be isolat- 
ed in the buffer stage and either read out separately and 
ignored, or dumped to a dump drain during the readout, 
as illustrated in the exemplary timing diagram of Figure 
9a. In Figure 9a charge packet storage and handling is 
shown versus filter wheel or liquid crystal shuttered filter 
switching time in a high speed 3 colour snap shot cam- 
era. Q v Q 2 and Q 3 indicate the amount of charge de- 
veloped during successive colour image frame expo- 
sures of a three colour image during different exposure 
periods with intermediate switching periods between 
them. Q s represents the colour cross talk charge stored 
in a buffer stage and thor dumped or ignored. The 
charge Q s between Q 2 and Q 3 is collected as the liquid 
crystal shuttered filter switches between colour #l and 
colour #2. Then Q s is stored in the memory (opaque) 
region and used to correct colours using software. Fig- 
ure 9b illustrates a super pixel charge sequence in keep- 
ing with the charging timing of Figure 9a. It will be un- 
derstood that variations of this technique may be em- 
ployed with a variety of exposure sequences to reduce 
cross-talk and improve dynamic range for charge from 
any of the exposures in a multiple frame application. 

Since scene illumination conditions change and tar- 
get colour contrasts are different, a real time chroma ed- 
iting feature may be provided wherein several timing, 



clocking, image sequences may be stored in a colour 
snap shot camera by applying different timing sequenc- 
es to the sensor of the invention. Accordingly, a photog- 
rapher or user is given the capability of adjusting the 
s exposure periods and the sampling resolutions of the 
various colours. The purpose of these adjustments is to 
allow the best quality colour contrast to be obtained in 
the image produced. The user may experiment with sev- 
eral real time chroma editing programs and decoding 

10 algorithms before settling on the optimal exposure con- 
ditions. These chroma editing programs and decoding 
algorithms may be pre-stored in the camera electronics 
and supported by the size of the image to storage re- 
gions in the image sensor. 

is a block diagram illustrating one embodiment of a 
camera incorporating an adjustable snap shot imager 
for real time chroma editing in accordance with the in- 
vention is shown in Figure 10. As seen in the Figure, a 
flash exposure of a colour image is directed by an im- 

20 aging lens 81 through a filter wheel, or liquid crystal filter 
shutter, 82 to an image sensor 83 in accordance with 
the invention. The output of the sensor 33 is digitized in 
an analog to digital converter 84 and fed a) directly to 
one input of an arithmetic logic unit (adder/subtractor) 

25 85 and b) to an external digital memory 86 having a 
black response and flat field illumination information. 
The contents of memory 86 are processed in a compo- 
nent 87 in the form of a digital arithmetic logic unit (ALU), 
or suitable software implementation, for filtering image 

30 correction flat field under different chroma editing 
schemes. The output of component 87 is coupled to the 
other input of adder/subtractor 85. which controls a scan 
converter 88 in presenting appropriate images, based 
on the flash input images, on a high resolution TV mon- 

35 itor 89 or film laser printer 99. To achieve real time chro- 
ma editing, a photographer's control panel 90 is provid- 
ed for operating a control device 91 that chooses differ- 
ent clock schemes, by means of an output to the ALU 
87. and selects the desired drive and control timing, by 

-to means of signals from an interface device 92 to the tim- 
ing controls for the filter wheel 82 and the image sensor 
83. The electronics will interpolate the pixels in the dis- 
played image over the opaque memory region. 

The foregoing embodiments achieve their improved 
results without mixing charge accumulated from differ- 
ent colour exposures in the sensor, thereby avoiding col- 
our decoding errors caused by non-linearities, CTE, 
dark current, quantization and fixed pattern noise. More- 
over, because of the smaller area required for the 

50 opaque storage regions, the embodiments of Figures 4 
- 6 can have high fill factors on the order of 70 to 80% 
over the full image active area. Also, as mentioned, 
these embodiments may be clocked in inverted, non- 
inverted, or mixed modes to enhance storage capacity, 

55 improve fill factor, and reduce dark current. 

In summary then the important features and advan- 
tages of this colour sensor architecture are: 
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1 . It provides a colour separation sensor that does 
not mix the colours to avoid colour decoding errors 
caused by non linearities, CTE, dark current, quan- 
tization, fixed pattern noise, and colour cross talk. 

5 

2. It has opaque storage regions among the image 
regions that are formed by depositing metal layers 
on the sensor permanently or by locating a glass 
filter, having predesigned opaque areas, in front of 

the sensor before an image exposure, or depositing io 
an opaque dielectric or liquid crystal material above 
the storage under bias control to turn opaque or 
transparent. 

3. It is compatible with large size MPP CCD in order is 
to avoid depositing colour filter matrix which will 
tend to lower the manufacturing yield on large area 
CCD devices. 

4. It is capable of a high fill factor, 70-80%. 20 




ther comprising means for clocking the means for 
storing multiple image frame exposures in one of 
the inverted, the non-inverted, or the mixed mode. 

4. An image sensor device as claimed in claim 1, 
wherein the array of image registers comprises a 
plurality of lines (504,510,511) of image registers 
and each storage register of the array comprises 
two lines of storage registers interspersed between 
four lines of image registers. 

5. An image sensor device as claimed in claim 1, 
wherein the array of image register means compris- 
es a plurality of lines of image registers (500) with 
blank lines (516) interspersed therein. 

6. An image sensor device as claimed in claim 1. 
wherein the arrays of storage registers comprise 
lines of storage registers (518,520) separated by 
imbedded barrier lines (522). 



5. It can be clocked in the inverted or the non-invert- 
ed or a mixed mode. 

6. It allows real time resolution adjustments of the 25 
chroma signals. 



7. It allows for colour cross talk correction by sepa- 
rating the colour cross talk charge produced during 
colour-switching in a separate site. 



Claims 

1 . An image sensor device of the snap shot type, com- 
prising an array of image registers (452, 472) for 
receiving the light from image frame exposures and 
producing charge packets in accordance therewith, 
an array of light-shielded storage registers (454, 
476) interspersed in regular displacements among 
the array of image registers for receiving the trans- 
fer of the charge packets from adjacent image reg- 
isters means for storage, the storage register com- 
prising means (502,508,509) for storing multiple im- 
age frame exposures, and means (458,478) for 
reading out the charge packets stored in the storage 
register. 

2. An image sensor device as in claim 1 , wherein the 
means for storing multiple image frame exposures 
comprises means (502) for receiving and storing 
the exposures in rapid sequence, and means 
(458,478) for reading out the charge packets com- 
prises means for reading out several of the stored 
exposures in sequence after all the multiple image 
exposures are completed. 

3. An image sensor device as claimed in claim 2 fur- 



7. An image sensor device as claimed in claim 1, 
wherein the arrays of image registers comprise a 
plurality of lines of image registers and the arrays 
of storage registers comprise continuous lines 
(503) of storage blocks interspersed between the 
plurality of lines (504) of image registers. 

8. An image sensor device as claimed in claim 1, 
30 wherein the arrays of image registers comprise dis- 
continuous lines (510) of image blocks and the ar- 
rays of storage registers comprise discontinuous 
lines (507) of storage blocks interspersed between 
the discontinuous Jines of image blocks. 

35 

9. An image sensor device as claimed in claim 1 . 
wherein the arrays of image register means com- 
prise staggered lines (501 ) of image blocks and the 
arrays of storage register means comprise stag- 

40 gered lines (509) of storage blocks alternating with 
each line of the image blocks. 

10. An image sensor device as claimed in claim 1, 
wherein arrays of image register means and arrays 

45 of storage register means are disposed in a vertical 
interline transfer (IT) arrangement. 

11. An image sensor device as claimed in claim 1 0, fur- 
ther comprising colour filter means (460) for produc- 

so ing the multiple image frame exposures. 

12. An apparatus for producing images using an image 
sensor of the snap shot type, comprising an image 
sensor as claimed in any one of the preceding 

55 claims, shutter means for producing a flash expo- 
sure of a colour image, colour filter means for pro- 
ducing multiple colour image frame exposures from 
said flash exposure, image sensor means for sens- 
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ing the multiple colour image frame exposures, and 
coupling the exposures to the image registers 
wherein the means for reading at the charge pack- 
ets produces image signals indicative thereof, the 
apparatus further including editing means respon- 
sive to the image signals for applying different chro- 
ma editing schemes thereto and producing editing 
signals in accordance therewith, ALU means for re- 
ceiving said image signals and said editing signals 
and producing an output based thereon for use in 
displaying a video image indicative of the colour im- 
age, and control means, coupled to the colour filter 
means and the image sensor means, for outputting 
control signals to control the timing of the producing 
and sensing of the multiple colour image frame ex- 
posures, and coupled to the editing means for out- 
putting selecting signals to select the chroma edit- 
ing scheme from among the different editing 
schemes to be applied to the image signals. 

13. An apparatus as claimed in claim 12, wherein the 
arrays of image register means and arrays of stor- 
age register means are disposed in a vertical inter- 
line transfer (IT) arrangement. 

1 4. An Apparatus as claimed in claim 1 2 or 1 3. wherein 
the editing means comprises an ALU. 

1 5. An apparatus as claimed in claims 1 2 to 1 4. wherein 
the image sensor means further comprises analog 
to digital converter means for converting the charge 
packets to digital image signals. 

16. An apparatus as claimed in claim 12 to 15. further 
comprising scan converter means for converting 
the output of the ALU means for use in displaying a 
video image. 

1 7. A method of producing images using an image sen- 
sor of the snap shot type, comprising the steps of 
disposing an array of image registers for receiving 
the light from image frame exposures and produc- 
ing charge packets in accordance therewith, dis- 
posing an array of light-shielded storage registers 
interspersed in regular displacements among the 
array of image registers and transferring the charge 
packets from adjacent image registers for storage 
in the storage registers during multiple image frame 
exposures ana reading out the charge packets 
stored in sate storage registers. 

18. A method as claimed in claim 17, wherein the pro- 
ducing and transferring of charge packets is done 
for multiple image frame exposures in rapid se- 
quence and the reading out of the charge packets 
is done in sequence after all the multiple image ex- 
posures are completed. 



19. A method as in claim 17, wherein a three colour im- 
age is obtained by the steps, comprising opening a 
shutter to produce a flash exposure of a colour im- 
age, rapidly acquiring the colour image by receiving 

s first, second, and third colour image frames se- 
quentially in the array of image registers to produce 
charge packets respectively indicative of the first, 
second, and third colour image frames, and rapidly 
transferring the charge packets indicative of the im- 

10 age frames sequentially into the adjacent storage 
registers from the array of image registers, closing 
said shutter and then reading out the charge pack- 
ets stored in the adjacent storage registers to a 
charge sense amplifier to obtain a three colour im- 

'5 age. 

20. A method as claimed in claim 17, wherein the steps 
are clocked in either the inverted, the non-inverted, 
or the mixed mode. 

20 
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(54) Electronic image sensor 



(57) An image sensor device capable of snap shot 
colour applications comprising an array of image regis- 
ters (452) for converting the light from successive image 
frame exposures into indicative charge packets, and an 
array of light-shielded storage registers (454) inter- 
spersed in regular displacements among the array of im- 
age registers for receiving the transfer of the charge 



packets from adjacent image registers over multiple im- 
age frame exposures, 

whereby for example, red, green, and blue colour image 
frames can be acquired upon the opening of a flash ex- 
posure shutter, and transferred in parallel into the stor- 
age registers from which the three frames can be read 
out as a colour image when the shutter is closed. 
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